"...not caring about what they think is a vital part of escaping."
This is absolutely true. No longer needing or wanting the approval of family, "friends", and the congregation helps you cut the cord cleanly. It's not easy, but it's the only way to be free and live your life.